User interface for stylus-based user input

ABSTRACT

Systems and methods for a user interface for stylus-based user input is described. In one aspect, a user interface is provided that includes an action area. The action area includes at least one helper icon that is selectable to allow a user to specify one or more subsequent stylus-based user inputs are to me interpreted as mouse-right-button input, hover cursor input, keyboard-like input, or handwriting input. The action area is for display responsive to receiving a stylus-based user input.

RELATED APPLICATIONS

This application is a continuation under 37 CFR 1.53(b) of cop-pendingand commonly owned patent application Ser. No. 09/998,020 filed on Nov.30, 2001, titled “User Interface for Stylus-Based User Input”, herebyincorporated by reference.

TECHNICAL FIELD

The following description relates to user interface.

BACKGROUND

User interface (UI) is often one of the most important parts of acomputer program because it determines how easily a user can communicatewith the program. A powerful program with a poorly designed UI haslittle value. Text-based and graphical user interfaces (GUIs) that usewindows, icons, and pop-up menus have become standard on personalcomputers. Text-based UIs as well as GUIs typically use an input device,such as a keyboard, mouse or stylus, to provide user input and controlthe movement of a cursor or pointer on a display screen.

A mouse is a small object you can roll along a surface. As you move themouse, a pointer on the display screen typically moves in the samedirection over various controls in a UI. Mice contain at least onebutton and sometimes as many as three, which have different functionsdepending on what program is running. For instance, consider that themouse has left and right buttons, wherein a left button selection (or“click”) is interpreted by the program as the selection of an underlyingcomponent of the UI. Whereas, a right mouse button click over that sameunderlying UI component may bring up a context-sensitive help menucorresponding to the underlying UI component; selection of any actionitems on the help menu can then be made by left-clicking the selecteditem. The help menu is context-sensitive, meaning that the content ofthe menu corresponds to the object that is underneath the mouse cursor.

For example, a right-click on a selected block of text in a MicrosoftWord document brings up a help menu offering action items such as “Cut”,“Copy”, “Paste”, “Font” and “Paragraph”. A right-click a blank spot onthe same Microsoft Word document brings up a menu where “Cut”, “Copy”and “Paste” are disabled. In the context of a web browser, however, aright-click on a blank spot of an HTML webpage brings up a menu offeringaction items such as “Back”, “Forward”, “Print” and “Refresh”.

In the event that a mouse is not desired or unavailable, a program UI isoften designed to work with a keyboard. For instance, a user may be ableto press a specific key (e.g., the “tab” key) to move a selection pointon the UI to highlight various controls (e.g., buttons, text inputcontrols, and so on). Context sensitive help for the highlighted controlmay be available via an additional press of another key on the keyboard.Additionally, a highlighted control can typically be selected with asubsequent press of another key (e.g., the “enter” key).

A general purpose home-based personal computer (PC) typically includesat least a keyboard and a mouse for a user to provide data input andcontrol the movement of a cursor or pointer on a display screen.However, the need for more portable computing is driving the computingindustry to develop ever more compact and portable computing devicessuch as laptops, personal digital assistants (PDA), digital tablets, andso on. These devices may or may not include a keyboard or mouseinterface.

For example, a PDA or a digital tablet may require the user to provideinput and control though a combination of a touch sensitive screen and apen-like pointing device or stylus, rather than through a conventionalkeyboard and mouse device. There are a number of problems that arisewith respect to attempting to provide an effective UI when moving from akeyboard and/or mouse interface to a pen-based computing device.

For instance, how does a user generate an equivalent to a“right-mouse-button click” with a pen or stylus to obtain contextsensitive help or context sensitive menus for a displayed underlying UIcomponent? Since pens are often used to provide such models or deviceswith handwritten user input and (e.g., characters, numbers, commandsglyphs, and so on), how do such devices provide for moving a displayedpointer or cursor across the display so that it lies over a desiredinsertion point or UI control? Traditional systems and techniques do notsatisfactorily solve these problems to allow a user to easily andintuitively communicate with a program in such a model.

The following description, together with the drawings, addresses theseand other problems of conventional UI design.

SUMMARY

Systems and methods for a user interface for stylus-based user input isdescribed. In one aspect, a user interface is provided that includes anaction area. The action area includes at least one helper icon that isselectable to allow a user to specify one or more subsequentstylus-based user inputs are to me interpreted as mouse-right-buttoninput, hover cursor input, keyboard-like input, or handwriting input.The action area is for display responsive to receiving a stylus-baseduser input.

BRIEF DESCRIPTION OF THE DRAWINGS

The same numbers are used throughout the drawings to reference likefeatures and components.

FIG. 1 shows an exemplary system to provide a user interface forstylus-based user input.

FIG. 2 shows an exemplary stylus helper control. Specifically, FIG. 2shows aspects of the helper control action area (HAA), which isdisplayed onto a display device (e.g., a touch screen) where a user hasinteracted in a particular manner with the screen.

FIG. 3 shows the action area of a stylus helper control superimposedover a computer program's user interface.

FIG. 4 shows an exemplary stylus control, wherein the helper action areaincludes of a number of helper icons representing tasks or modes ofoperation that are accessible via the stylus control. FIG. 4 furtherillustrates exemplary use stylus movements and selections that directthe behavior of the stylus helper control.

FIG. 5 shows exemplary program module architecture and data flow toallow a user to specify that certain stylus-based user input events areto be interpreted as a mouse-right-button click event, hover cursorevents, keyboard-like events, or handwriting events. Specifically, FIG.5 shows exemplary program module architecture and data flow to provide auser interface for stylus-based user input.

FIG. 6 shows an example of how, once a transcriber application isactivated with the stylus helper UI, that a user can scribble orhandwrite over a different program's UI without causing any stylus-basedhandwriting events (i.e., those events generated during the generationof the handwriting) to be communicated to the different program.

FIG. 7 shows an exemplary procedure for implementing a user interfacefor stylus-based user input.

FIG. 8 shows further aspects of an exemplary procedure for implementinga user interface for stylus-based user input.

FIG. 9 shows further aspects of an exemplary procedure for implementinga user interface for stylus-based user input.

FIG. 10 illustrates aspects of an exemplary suitable operatingenvironment in which a user interface for stylus-based user input may beimplemented.

DETAILED DESCRIPTION

The following description sets forth exemplary arrangements andprocedures for providing a pen or stylus based user interface. Thesubject matter is described with specificity to meet statutoryrequirements. However, the description itself is not intended to limitthe scope of this patent. Rather, the inventor has contemplated that theclaimed subject matter might also be embodied in other ways, to includedifferent elements or combinations of elements similar to the onesdescribed in this document, in conjunction with other present or futuretechnologies.

Overview

A user interface (UI) for computing devices that receive stylus orpen-based user input is described. The UI addresses problems (e.g., howto provide right-mouse-button clicks, cursor hovering, and so on) thatarise when moving from a keyboard and/or mouse user input model to apen-based user input model. To address these problems, the UI interceptspen-based user input events before they are distributed to otherapplications (e.g., by an operating system (OS)). Each intercepted eventis analyzed to determine if the event:

(a) represents a request to display (e.g., a continuous touch userinput) a stylus helper control or menu, which allows a user to executevarious tasks or modes of operation, each of which specify how a numberof subsequent stylus-based input events are to be interpreted or handled(e.g., a right-mouse-button click, a hover cursor mode request, akeyboard-like input mode request, or a handwriting mode request);

(b) represents user selection of a task/mode of operation (e.g., astylus un-touch event over a respective icon in the stylus helpercontrol);

(c) represents stylus-based user input into an active stylus helpertask;

(d) represents a request to dismiss a displayed stylus helper control orexit an active stylus helper task/mode of operation; or

(e) represents user input (e.g., a quick stylus-touch event represents aleft button click) that is to be immediately returned to the OS forregular distribution to any interested other applications.

Upon dismissal (user or automatic dismissal) of the stylus helpercontrol without user selection a helper task, certain events or userinput that caused the display and dismissal of the control are forwardedto the OS for distribution and regular processing by any interestedother applications. Additionally, upon completion of a selected helpertask, any results of the task (e.g., cursor coordinates, recognizedhandwriting, ASCII characters, a right-mouse-button click, mappedevents, etc.) are communicated to an underlying program (e.g., a textinput box in a Web browser) for processing.

An Exemplary System

FIG. 1 illustrates an exemplary system 100 to provide a user interfacefor stylus or pen-based user input. The system includes a display device102 (e.g., a touch-screen, digital pad, a monitor, a portableinteractive display device, and so on) that is operatively coupled to acomputing device 104. The computing device 104 is operational as any oneof a number of various computing devices such as a PC, a server, a thinclient, a thick client, a hand-held PDA, a portable interactive display,a digital tablet, a laptop device, a multiprocessor system, a set topbox, programmable consumer electronics, a wireless phone, an applicationspecific integrated circuit (ASIC), and so on.

The host computer includes a processor 106 that is coupled to a systemmemory 108. The system memory 106 includes any combination of volatileand non-volatile computer-readable media for reading and writing.Volatile computer-readable media includes, for example, random accessmemory (RAM). Non-volatile computer-readable media includes, forexample, read only memory (ROM), magnetic media such as a hard-disk, anoptical disk drive, a floppy diskette, a flash memory card, a CD-ROM,and so on.

The processor 106 is configured to fetch and execute computer programinstructions from program modules 108; and configured to fetch data 112while executing one or more of the program modules 110. Program modulestypically include routines, programs, objects, components, datastructures, and so on, for performing particular tasks or implementingabstract data types.

For instance, program modules 110 include the stylus helper module 114,registered stylus helper applications 116, other applications 118, anoperating service module 120, and a device driver module 122. The stylushelper module 114 provides a UI for stylus-based input for a user toeasily implement: (a) keyboard-like and/or mouse-like functionality witha stylus; (b) selection of another program's underlying UI controls; (c)right mouse clicks (e.g., to obtain context-sensitive help or menus);(d) cursor or “pointer” movement (i.e., cursor hovering) over anotherprogram's underlying UI components; (e) simple and quick access tosoftware applications, operational modes; (e) etc.

To provide such a UI, the stylus helper module 114 displays and hides astylus user input or stylus helper control, which is described ingreater detail below in reference to stylus helper control 202 of FIGS.2-4, based on user stylus-based user input. Such user input generatesone or more events that are mapped to certain configurable responses.The stylus helper control 202 provides a quick and simple way for theuser to interact with an underlying computer program's UI (e.g., providekeyboard-like and/or mouse-like input), invoke other tasks or modes ofoperation (e.g., a registered stylus helper application 116), and so on.

To accomplish these various functionalities, the stylus helper module114 intercepts, analyzes, and directs touch screen 102 events (e.g.,stylus press and movement events) before they are processed by theregistered stylus helper applications 116, other applications 118, oroperating services 120. Such intercepted, analyzed, and redirectedevents are described in greater detail below in reference to FIGS. 5-6,and TABLES 1-4.

Registered stylus helper modules 116 are computer applications thatprovide additional functionality to the stylus helper module 114. Thereare various ways that an application 116 may register with the stylushelper module 114, including, for example, by identifying a helper icon(e.g., the helper icons 402 of FIG. 4) to represent and access theapplication. As discussed in greater detail below, helper icons aredisplayed in a helper action area 208 of the stylus helper control 202of FIGS. 2-4. There can be any number and type of registered stylushelper modules 116.

In this example, the registered stylus helper modules 116 include theright-mouse button click module 124-1, the simulated keyboard inputmodule 124-2, the cursor hover module 124-3, and the transcriber module124-N. These additional functionalities of the registered stylus helpermodules 116 are accessible via the stylus helper control 202 of FIGS.2-4. Procedures to access stylus helper control 202 functionality andthe additional functionalities of the registered stylus helperapplications 116 are described in greater detail below in reference toFIGS. 2-5 and the stylus-based event to action mappings shown in TABLES1-4.

The right-mouse button click module 124-1 provides a user with a simpleand intuitive technique to generate a right-mouse-button click (e.g., toobtain context sensitive help corresponding to another computerprogram's underlying control, to perform some other action that ismapped by the underlying control's computer program application to theright-mouse button click, and so on) when the user is providing inputwith a stylus, rather than with a mouse or keyboard device. Thetechnique to generate such a right-mouse-button click with a stylus isdescribed in greater detail below in reference to right-mouse-clickhelper icon 402-1 of FIG. 4.

The simulated keyboard module 124-2 provides a user with a simple andintuitive technique (e.g., a keyboard-like graphic control (not shown)displayed on the touch-sensitive screen 102) to generate text,punctuation; escape characters, and so on, with a stylus. The procedureto instantiate the simulated keyboard module 124-2 is described ingreater detail below in reference to the keyboard helper icon 402-2 ofFIG. 4.

The cursor hover module 124-3 provides a user with a simple andintuitive technique to display and maneuver or drag a cursor overanother program's underlying UI. This cursor hover movement is providedindependent of sending any of the stylus-movement events correspondingto such maneuvering to any underlying UI controls. The procedure toinstantiate the cursor hover task 124-3 is described in greater detailbelow in reference to cursor hover helper icon 402-3 of FIG. 4.Stylus-based event mapping to cursor hover mode-based actions aredescribed in greater detail below in reference to TABLE 3.

The transcriber module 124-N provides a user with a simple and intuitivetechnique to provide interpreted handwritten input to an underlyingcomputer program (e.g., a Web browser application) without beingconfined to a window that is provided by the underlying program.Instead, because the stylus helper module 114 intercepts stylus-basedtouch events, the user can scribble or handwrite over the top of anunderlying program's UI without concern of accidentally invoking one ofthe underlying program's UI controls.

An exemplary procedure to instantiate the transcriber module 124-N isdescribed in greater detail below in reference to transcriber helpericon 402-N of FIG. 4. An example of the use of the transcriber module124-N is described in greater detail below in reference to FIG. 6.Stylus-based event mapping to transcriber-based actions are discussed ingreater detail below in reference to TABLE 4.

The other applications 118 module includes, for example, a Web browserapplication, a word processor, and so on. Operating services 118include, for example, an operating system such as any one of a number ofvarious Microsoft Corporation WINDOWS operating systems (OS) or services(e.g., Windows CE® shell services).

An Exemplary Stylus Helper UI

FIG. 2 shows an exemplary menu 202 for a user interface for stylus-baseduser input. Hereinafter, the menu 202 is often referred to as the stylushelper control 202. Specifically, FIG. 2 shows that the exemplary stylushelper control 202 includes an optional indication 204 of where a userhas “touched” the screen 206 of the display device 102 with a stylus210. In this example, the optional indication 204 is a crosshair symbol204. The crosshair 204, however, could be any of a number of othervarious symbols to identify where a user has “touched” the screen of thedisplay device 102 with the stylus. Additionally, the term “touched” canindicate that the user has physically touched the screen 206 with thestylus. Alternatively, the term touched can indicate that the stylus hascome into close proximity to the screen. In this alternative example,the screen and the stylus may include components that respectivelyindicate when the stylus is near a particular location on the screen.

The exemplary stylus helper control 202 further includes a styluscontrol helper action area (HAA) 208. In this example, the HAA 208 is acircle with a radius r that is centered on the crosshair 204. The HAA208 can be a geometrical shape other than a circle 208 (e.g., a square,a triangle, etc.). Additionally, although this example shows the outlineof the HAA 208 on the screen 206, the HAA 208 outline is optional andimplementation specific (e.g., the implementation may depend on ease ofdifferentiation between the control 202 and a particular program'sunderlying UI components, user feedback, and so on).

FIG. 3 shows a stylus helper control 202 superimposed over a computerprogram's user interface 302. When a user touches the screen 206 at alocation (e.g., location 204) with a stylus and holds the stylus at thatlocation for a certain and configurable amount of time, the stylushelper module 114 displays the control 202 onto the screen 206. Ifcomponents of another program's UI 302 underlie the location where theuser has touched the screen 206, the stylus helper control 202 issuperimposed over the other UI components 302. By superimposing thecontrol 202 over any underlying UI components, the user is able todetect what is underneath the touch point 204.

Accordingly, the stylus helper control 202 allows a user to position thetouch point 204 of the helper control 202 over another program'sunderlying control in a manner that allows the user to still view theunderlying control. A control that underlies the touch point 203typically has some operational context that may be implemented by thecomputer program that is managing the underlying control. However, thestylus helper menu 202 does not correspond to any underlying control'soperational context.

For instance, consider that a right-mouse-button-click over a selectedblock of text in a word processing document typically results in amouse-click event being communicated to the word processing program thatmanages the selected block of text. Responsive to receiving the event,the word processing program may display a context sensitive help menucorresponding to the selected block of text and offering action itemssuch as “Cut”, “Copy”, “Paste”, “Font” and “Paragraph”. Thus, theconventional help menu of this example is not independent of the contextof the underlying selected block of text. Rather, the conventional helpmenu directly corresponds to the operational context of the selectedblock of text (e.g., aspects of the underlying control).

In contrast to such conventional operating behavior, when the stylusmenu 202 is displayed over an underlying UI control, the menu 202 isindependent of the underlying object's corresponding context ofoperation. To achieve such independence, the stylus helper module 114intercepts any stylus-based user input, including any input resulting inthe display of menu 202, such that the particular computer program thatmanages the underlying control will not receive the user input-unlessthe stylus module 114 subsequently causes the event to be forwarded tothe particular program. (Until such user input is forwarded, theparticular program cannot generate or present any contextually relevantinformation (e.g., a context sensitive help menu) corresponding to acontrol that underlies the stylus menu 202). Thus, the stylus menu 202is independent of any underlying object's corresponding context ofoperation.

FIG. 4 shows an exemplary stylus helper action area (delimited by thecircle 208) comprised of a number of helper icons 402 to represent andfacilitate access to one or more of the registered stylus helperapplications 116 of FIG. 1. There can be any number of helper icons 402,text, and so on, displayed on the periphery of the HAA 208. In thisexample, the helper icons 402 allow a user to specify that the computersystem 100 of FIG. 1 is to interpret one or more subsequent stylus-baseduser input events as a mouse-right-button click event, hover cursorevents, keyboard-like events, or handwriting events.

For instance, helper icon 402-1 is mapped to the right mouse-buttonclick module 124-1 of FIG. 1 to provide a “right mouse-button click”action. Helper icon 402-2 is mapped to the sim-keyboard module 124-2 todisplay a keyboard for a user keyboard-like input with a pen. Helpericon 402-3 is mapped to cursor hover module 124-3 of FIG. 1 to provide a“cursor hover” mode of operation, wherein a pointer or cursor can bedragged with the pen to various screen 206 locations, and dropped at anyone or more of those locations. Helper icon 402-N is mapped to thetranscription computer program 124-N for entering a handwritingrecognition mode of operation, wherein pen-strokes on the display areinterpreted as handwriting input rather than selections, mouse hoveringactions, and so on.

By “touching” the screen 206 with a stylus at a location (e.g., location204) and holding the stylus at that location for a certain amount oftime, the helper UI 202 is displayed. To instantiate a program or moderepresented by an icon 402, the user moves the stylus from location 204towards an icon 402 (indicating a desired task) without removing thestylus from the screen 206. Dotted lines 404 indicate stylus movementfrom location 204 to a position on the screen 206 that overlies orintersects one of the displayed icons 402. Upon reaching a point on thescreen 206 that overlies or intersects one of the icons 402, the userlifts the stylus to perform the action or enter the mode of operationindicated by the underlying icon 402. In this manner, the stylus helperUI 202 provides a quick way for the user to invoke actions and/or entermodes of operation with the stylus.

The stylus helper module 114 provides these and other aspects of thehelper control UI 202 by mapping events (e.g., user touch events, styluslifting events, timer expiration, user stylus drag events, and so on) toparticular helper control 202 behavior, registered stylus helperapplication 116 functionality, and so on. Examples of stylus-basedevents that are mapped to specific helper control 202 or registeredhelper application 124 behaviors are described in greater detail belowin reference to TABLES 1-4.

The stylus helper module 114 provides a number of techniques for a userto dismiss or hide the stylus helper UI 202. One way for a user to hidethe helper UI 202, for example, is by dragging the stylus beyond the HAA208 without selecting one of the helper tasks/modes indicated by arespective icon 402. To illustrate this, consider that the user dragsthe stylus from point 204 and across the screen 206, as indicated bydotted line 406. Immediately after the user drags the stylus past thepoint 408 on the screen, which represents the intersection of path 406with the outer perimeter of the HAA 208, the stylus helper module 114hides the helper control 202. This path 406 extending beyond the HAA208, which causes the dismissal of the control 202, can be over anyportion of the control 202, including directly over any of the displayedicons 402.

Additionally, the stylus helper module 114 will dismiss the helpercontrol 202 if the user does not select one of the tasks 402 within aparticular amount of time from control 202 instantiation (i.e., afterthe helper control 202 has been displayed).

An Exemplary Program Module Architecture and Data Flow

FIG. 5 shows exemplary program module architecture and data flow toprovide a stylus helper user interface. The touch driver module 122includes one or more device drivers (e.g., a touch-screen driver todetect and translate user pen-based input from the display device 102, amouse driver, a keyboard driver, etc.) to translate and communicate userinput to a program such as the stylus helper module 114 or operatingservices 120.

For instance, when the touch driver 122 receives stylus or pen-baseduser input from the display device 102 (e.g., the touch screen 206 ofFIG. 2), the driver 122 communicates the corresponding event(s) to thestylus helper module 114 (i.e., see the events 126 of FIG. 1). Suchtouch driver 122 events include interactions between a stylus and thedisplay 102 (e.g., stylus/screen touch-events, stylus lifting events,stylus drag events, and so on). The stylus helper module 114 processesthese communicated events before they are optionally passed to othercomputer programs such as one or more of the registered stylus helpermodules 116, the operating services 120 (i.e., the system), and so on,for further processing (i.e., transforming the events mouse-like eventsto be communicated to any number of the other applications 118).

Lines 502 that are capped with direction arrows represent data or eventflow between the various program modules 108. A screen device 102 thatis receptive to stylus-based user input generates a signal or eventresponsive to such input. This signal is communicated, as shown by arrow502-1, from the OEM hardware 102 to the touch-screen display driver 122.The touch driver 122 forwards this event, as shown by arrow 502-2) tothe stylus helper module 114 for further processing. The stylus helpermodule 114 analyzes the forwarded event to determine if it is mapped toa stylus control 202 or a registered stylus helper 116 action orbehavior. These mappings are described in greater detail below inreference to TABLES 1-4. If such a mapping exists, then the mappedaction(s) is/are performed.

The stylus helper module 114 may then communicate the intercepted event122 (see, line 502-2), or another event that is mapped to theintercepted event, (a) back to the touch driver 122 (e.g. arrow 503-3);(b) to the operating services 120 (e.g. line 503-4); or, (c) to one ormore of the registered stylus helper modules 116 (e.g., line 508-7) foradditional processing. Where the stylus helper 114 communicates theanalyzed event back to the touch driver (e.g., 502-3), the touch driverwill forward the event (e.g. arrow 503-5) to the operating services 120.In either case, responsive to receiving the forwarded event, theoperating services 120 communicates a corresponding event or message(e.g., right or left button clicks, mouse move messages, button-upmessages, and so on) to any other applications 118 that have indicatedinterest in such events (e.g., arrow 502-6).

When the stylus helper module 114 communicates the intercepted event toone or more of the registered stylus helper modules 116, the receivingmodule(s) will process the event according to its particularimplementation. The particular implementation of a registered stylushelper module 116 may (or may not) result in the communication of theintercepted event—or a different event that was mapped to theintercepted event, to the operating services (i.e., line 503-8).

For instance, consider that the event is a stylus lift event over alocation that intersects the right-click helper icon 402-1 of FIG. 4.The event is forwarded by the touch driver 102 to the stylus helpermodule 114 (see, lines 502-1 and 502-2). The stylus helper module 114determines that the event should be forwarded to the right-mouse-buttonclick module 124-1 of FIG. 1 (see, line 503-7). Responsive to receivingthe forwarded event, the click module 124-1 generates a“right-mouse-button click” event or message, which includes the location(e.g., stylus helper data/stylus coordinate information 126 of FIG. 1),to operating services 120 for communicating to any interested otherapplications 118 (an “interested” other application 118, in this case,is an application that processes right-mouse-button click events ormessages). In this manner, a user can easily generate a right-click witha stylus input device.

Moreover, a registered stylus helper module 116 may communicate data(e.g., mouse or pointing device coordinates, handwriting or interpretedhandwriting data, a right-mouse-button click event, ASCII text,punctuation or number, and so on) corresponding to its particularimplementation directly to one or more of the other applications 118.Such data or task result communication between modules 108 isrepresented by line 502-9.

Table 1 illustrates an exemplary mapping between stylus-based touchevents and helper control 202 and/or registered stylus helperapplication 116 behavior.

TABLE 1 EXAMPLES OF EVENT/ACTION MAPPING Events Generated by UserInteraction with the Stylus/Touch Stylus Helper Stylus Stylus HelperOperating Screen 102 Module 114 Helper Module 114 Services 120 RowEvent(s) Timer Event Control 202 Action Action 1 single quickexpired/not none no action left mouse touch expired button click 2double quick expired/not none no action left mouse touch expired buttondouble click 3 continuous not expired none show stylus none touch and nohelper (active) movement (touch and hold) 4 expired none hide stylusleft mouse helper button down 5 moving not expired inside stylus showstylus none continuous helper area helper with touch after and over ahighlighted stylus helper particular icon, is active icon indicatingselection 6 outside stylus hide stylus left mouse helper area helperbutton down and mouse move event(resulting in dragging, highlighting,inking, etc.) 7 expired none hide stylus left mouse helper button downand mouse move event (resulting in dragging, highlighting, inking, etc.)8 untouched, not expired inside stylus hide stylus Left mouse after anyhelper area helper down and left continuous and not over a mouse buttontouch and particular up stylus helper icon is still active 9 insidestylus hide stylus Handle helper area helper particular and over aaction (refer to particular table 2) icon 10 any touch n/a n/a n/acorresponding when stylus mouse event helper is not active

Col. 1 of Table 1 identifies user instantiated events between a stylusand a touch screen 102. Col. 2 of Table 1 identifies a timer status(e.g., expired, not expired, N/A). The stylus helper module 114 starts,monitors, and maintains the timer. Specifically, the timer is startedwhen a user invokes the stylus helper control 202. The timer is stoppedor killed when a predetermined amount of time has expired without anyuser interaction with the helper control. The timer is also killed inresponse to certain user actions, as described in greater detail below.

Col. 3 identifies stylus helper module 114 based events that aregenerated responsive to direct user interaction with aspects of thestylus helper control 202. Col. 4 identifies any action that is taken bythe stylus helper module 114 responsive to any of the events identifiedin cols. 1-3. Col. 5 identifies actions that may be performed by thesystem 120 responsive to the stylus helper module 114 causing an eventor message, which may or may not be the exact event identified in cols.1-4, to be communicated to the system 120.

As indicated by cols. 1-5, row 1, responsive to a single quick touch ofa stylus to a touch screen 102, the stylus helper module 114 takes noaction other than to return the intercepted event back to the touchdriver 122 or to the system 120, whereupon it may be generated into aleft-mouse-button click that is communicated to the other applications118.

Row 2 shows that responsive to a double quick touch of the displayscreen 102, the stylus helper module 114 takes no action other than toforward the event back to the touch driver 122 or to the system 120,whereupon it may be generated into a left-mouse-button double-click thatis communicated to the other applications 118.

Rows 3 and 4 of Table 1 correspond to continuous non-moving touchevents. Row 3 shows that a continuous non-moving touch event causes thestylus helper module 114 to present the stylus helper control 202 ofFIGS. 2-4. However, row 4 of Table 1 shows that if a time-to-displaytimer (started by the stylus helper module 114 when it displays thecontrol 202) expires (e.g., because the user has not selected a helpericon 402, moved the stylus out of the HAA 208, etc.) the helper module114 will hide the helper control 202 and communicate an event to thetouch driver 122 or to the system 120. The system 120 upon receipt ofthe communicated event causes a left button down event identifying thelocation where the control 202 had been centered (i.e., location 204) tobe forwarded to any interested other applications 118. Thetime-to-display timer is stopped as soon as the user either selects anicon 402 or moves the stylus out of the HAA 208.

Rows 5-7 of Table 1 correspond to continuous moving touch events afterthe stylus helper control 202 is active. Row 5 shows that a continuousmoving touch event causes the stylus helper module 114 to present thestylus helper control 202 to highlight a particular icon 402. However,row 6 of Table 1 shows that the stylus is moved beyond the HAA 208 ofthe control 202: (a) the stylus helper module 114 will hide the control202 and communicate the event to the touch driver 122 or to the system120; and (b) responsive to receiving the event, the system 120 causes aleft button down event and mouse move messages to be forwarded to anyinterested other applications 118.

Row 7 shows that after displaying the helper control UI 202 responsiveto detecting continuous moving touch events, if a time-to-display timer(started by the stylus helper module 114 when it displays the control202) expires because the user has not selected a helper application 402,moved the stylus out of the HAA 208, etc: (a) the helper module 114 willhide the helper control 202 and communicate the event to the touchdriver 122 or to the system 120; and (b) responsive to receiving theevent, the system 120 causes a left button down event and mouse movemessages to be forwarded to any interested other applications 118.

Row 8 of Table 1 indicates that if the user lifts the stylus at any timefrom the display screen 102 when the stylus helper control 202 isdisplayed or active (i.e., the stylus was not positioned over an icon402 when the stylus was lifted from the screen, the stylus is stillpositioned in the HAA 208, etc.), that the stylus helper module 114 willhide the helper control 202 and communicate the event to the touchdriver 122 or to the system 120 such that a left-mouse-button down andup event is forwarded by the system 120 to any interested otherapplications 118. Row 9 indicates that if a stylus is positioned over anicon 402, when the stylus is lifted from the screen the stylus helper114 activates the appropriate helper module 116 to handle acorresponding task.

Row 10 of Table 1 indicates that any touch event of the stylus to thescreen 206 when the stylus helper control 202 is not active that did notresult in the selection of a task represented by a displayed icon 402(e.g., a stylus lift event over an icon causing a corresponding task ormode and the dismissal of the helper control 202), results in acorresponding mouse event being communicated by the system 120 to anyinterested other application 118.

TABLE 2 EXAMPLES OF EVENT/ACTION MAPPING Events Generated by Stylus UserInteraction with Helper the Stylus Helper Module 114 Control 202 ActionOperating Services 120 Action Stylus helper control Touch eventsgenerated within a helper action area tasks/ control 202 may not betranslated into modes include, equivalent system mouse events. forexample: Rather, the stylus helper 114 may map any event sent to thetouch driver 122 or system 120 based on the selected task's/mode'sfunctionality. For instance, the tasks/modes (a-e) in col. 1 are mappedto corresponding events/actions (a-e) in this column. hide stylus helper(a) right click task; (a) right button click; (b) cursor hover mode; (b)provides hover cursor; the user can (c) keyboard task; and use thiscursor to perform click and (d) any other user/OEM drag functionality;it expires after a tasks/modes/macros; timer expires w/no action, ordismiss when user lifts off the icon. (c) pop up software inputmechanism; (d) E.g., a handwriting transcriber mode with a displayedtranscriber indicator, and so on.

Col. 1 of Table 2 identifies further stylus helper module 114 basedevents (i.e., events that are generated responsive to direct userinteraction with aspects of the stylus helper control 202). Col. 2identifies further action that is taken by the stylus helper module 114responsive to any of the events identified in col. 1. Col. 3 identifiesactions that may be performed by the system 120 responsive to the stylushelper module 114 causing an event, which may or may not be the eventidentified in col. 1 to be communicated to the system 120.

In the example of FIG. 4, the helper control 202 includes a number ofhelper icons 402 such as the right-mouse-button click icon 402-1, thesimulated keyboard icon 402-2, the cursor hover operational icon 402-3,and the handwriting transcription icon 402-N, and so on. Responsive touser selection of any of these or other icons 402 shown in the HAA 206(i.e., instantiating the control 202 at some location on the screen 206,dragging the stylus from the location to intersect one of thecorresponding task/mode icons 402, and lifting the stylus off of thescreen 206—touch events 122 of FIG. 1), the stylus helper module 114hides the control 202 and instantiates a corresponding registered stylushelper application 116 of FIG. 1.

TABLE 3 EXAMPLE OF HOVER MODE MAPPED EVENTS AND ACTIONS Touch ScreenEvent Hover UI System Action 1 single/double active left mouse quicktouch click/double click outside Hover UI 2 single quick touch hide UIand exit none inside hover Hover UI 3 continuous active no mouse touchbutton down, only send mou moves

Table 3 shows cursor hover mode 124-3 of FIG. 1 action to event mappingsthat are made by the stylus helper module 114 once a user has selectedthe cursor hover icon 402-3 of FIG. 4. Upon hover mode 124-3 activation,a cursor is displayed onto the screen 102. Row 1 of Table 3 indicatesthat a single/double quick touch hover UI causes the stylus helpermodule 114 to communicate a left mouse click/double click to the touchdriver 122 or to the system 120. Row 2 of Table shows that a singlequick touch event causes the stylus helper module 114 to hide any hoverUI and exit the hover mode (i.e., exit the hover task 124-3).

Row 3 of Table 3 corresponds to a continuous touch of the stylus on thescreen 102 when the Hover module 124-3 is active. Responsive to such acontinuous touch on the displayed cursor, the hover module 124-3translates the continuous touch to mouse moves, moving and manipulatingthe hover cursor.

TABLE 4 EXAMPLE OF TRANSCRIBER TASK MAPPED EVENTS AND ACTIONSTranscriber Touch Screen Indicator Transcriber Event Selected IndicatorUI System Action any touch n/a Visible Transcriber event, excepttransformed touch for single events into mouse and quick touch keyboardevents single quick Yes Hide and exit None touch transcriber mode.

Table 4 shows transcriber task 124-N of FIG. 1 stylus-based input eventto action mappings. The stylus helper module 114 and/or the transcribertask 124-N perform the actions corresponding to these mappings once auser has activated the transcriber task 124-N via the helper icon 402-Nof FIG. 4. Specifically, row 1 shows that once a transcriber icon 402-Nis selected, the stylus helper control 202 communicates any touch-event,with the exception of a single quick touch event, to the transcribertask 124-N.

Row 2 shows that a single quick touch event causes the stylus helpermodule 114 to hide any transcription indication UI and exit thetranscriber mode (i.e., exit the transcriber task 124-N). Because thestylus helper module 114 does not communicate any stylus-based inputevents to the operating services module 120 when the transcriber task124-N is active, the stylus helper module 114 enables a user of thetranscription task to scribble or handwrite over a different program'sUI without causing any stylus-based handwriting events (i.e., thoseevents generated during the generation of the handwriting) to becommunicated to the different program.

FIG. 6 shows an example of the use of the stylus helper control 202 toimplement a handwriting recognition application 124-N. Specifically,once the transcriber application 124-N is activated via the stylushelper control 202 (e.g., see stylus path 404-3 to helper icon 402-N ofFIG. 4), the helper control 202 is hidden by the stylus helper 114module. At this point, the stylus helper module 114 is in a transcriberoperating mode. The user can scribble or handwrite 602 over a differentprogram's UI 604 using stylus 210. All stylus-based handwriting events(i.e., those events generated during the generation of the handwriting)are intercepted by the stylus helper module 114 and communicated to thetranscriber application 124-N. Whether or not any stylus-basedhandwriting events (i.e., those events generated during the generationof the handwriting) are communicated back to the touch driver 122 ordirectly to operating services 120 for distribution to otherapplications 118 is optional and based on the particular implementationof the transcriber module 124-N.

An Exemplary Procedure

FIG. 7 shows an exemplary procedure 700 for implementing a userinterface for stylus-based user input (i.e., the user interface providedby the stylus helper module 114 of FIG. 1). At block 702, stylus-baseduser input is received. At block 704, the procedure determines if theinput indicates that the user desires to access the stylus helpercontrol 202 of FIGS. 2-4. There are various ways for the user to providesuch as indication. For instance, as shown in Table 1, a continuoustouch event causes the stylus helper module 114 to display the helpercontrol 202.

At block 706, it having been determined at block 704 that the user doesnot desire to access the control 202 (e.g., by providing quick single ordouble touch events), the received event (block 702) is forwarded to theoperating system for processing (e.g., for subsequent distribution toany interested other applications 118). Otherwise, at block 708, thestylus helper module 114 displays the stylus helper control 202; thisincludes a number of helper icons 402 that allow the user to determinehow subsequent stylus-based input is to be processed. The procedure 700continues at reference “A”, which corresponds to block 802 of FIG. 8.

FIG. 8 shows further aspects of an exemplary procedure 700 forimplementing a stylus helper user interface (i.e., the user interfaceprovided by the stylus helper module 114 of FIG. 1). At block 802, theprocedure determines if the stylus helper control 202 should bedismissed or hidden because of user action or inaction that has notresulted in the instantiation of a task corresponding to one of thedisplayed helper icons 402. If so, at block 804, the procedure dismissesthe control 202.

There are a number of user actions or inactions that do not result inthe instantiation of a task corresponding to one of the displayed helpericons 402. For instance, if the control 202 has been displayed for apredetermined amount of time without any user selection of one of thehelper icons 402, the procedure (i.e., block 804) hides the control 202.Additionally, if the user lifts the stylus from the control 202 withoutselecting one of the helper icons 402, the control 202 is hidden.Additionally, if the user moves the stylus out of the control's actionarea 208, the control 202 is dismissed.

At block 806, the procedure communicates any event(s) corresponding tothe display and dismissal of the control 202 to the operating services120 for further processing (e.g., distribution to other applications118). Such event that are communicated to the operating services 120 arelisted above in the last column of Table 1. The procedure continues at“B”, which is represented by block 702 of FIG. 7.

At block 802, if the procedure determines that the user has selected atask corresponding to one of the displayed helper icons 402, theprocedure continues at block 808, where the control is also hidden. Atblock 810, the procedure performs the task corresponding to the helpericon 402 that was selected by the user. The procedure continues at “C”,which is represented by block 902 on FIG. 9.

FIG. 9 shows further aspects of an exemplary procedure 700 forimplementing a stylus helper user interface (i.e., the user interfaceprovided by the stylus helper module 114 of FIG. 1). At block 902, theprocedure determines whether the selected task (block 802 of FIG. 8)requires re-direction of stylus-based user input to the task. Forinstance, if the selected task is the right-mouse-button click task124-1 that corresponds to the helper control 402-1 of FIG. 4, the stylushelper module 114 or the task 124-1 communicates a right-mouse-buttonevent/message to the operating services 120 for further distribution toany interested other applications 118. Thus, in this example, subsequentstylus-based events do not need to be forwarded to the selected task.

However, if the selected task were the keyboard task 124-2, the cursorhover task 124-3, the transcribe task 124-N, or the like, the eventsneed to be communicated to the selected task for further processing. Forinstance, the hover cursor module 124-3 uses the subsequent stylus-basedinput to calculate new screen 102 coordinates to move the cursor orpointer across the user interface. In another example, the simulatedkeyboard task 124-2 uses the subsequent stylus-based input to determinewhich keys a user has selected. In yet another example, the “transcribe”or handwriting recognition task 124-N uses the subsequent stylus-basedinput to identify and analyze user handwriting.

Accordingly, at block 904, the procedure having determined that theselected task (block 802 of FIG. 8) does not require re-direction ofstylus-based user input, dismisses the control 202. The procedure 700continues at “B”, represented by block 702 of FIG. 7.

At block 906, the procedure receives stylus-based input (the procedurehaving determined at block 902 that the selected task (block 802 of FIG.8) requires re-direction of stylus-based user input). At block 908, theprocedure determines if the received event (block 906) indicates orsignals that the user is done with the selected task. For instance, whenthe task is the hover task 124-3 or the transcribe task 124-N, thesignaling event may be a quick single or double click anywhere on thescreen 102. Or, when the task is the keyboard task 124-2, the signalingevent may correspond to a location on the screen other than where thegraphic of the keyboard is displayed.

At block 910, the event having been determined to not signal the taskcompletion, the event is redirected to the selected task 124 forprocessing. At block 912, the event having been determined to signalthat the user is finished with the task 124, the task is completed. Atask can be completed in a number of different ways, each dependent onthe task. For instance, if the task is the transcribe task 124-N, thisblock 912 of the procedure can indicate that any handwriting that wasscribbled on the display 102 is to be interpreted and the results sentto an underlying program such as a Web browser. If the task was thehover task 124-3, the position or coordinates of the cursor on thedisplay 102 may be identified and communicated to another program. Theprogram receiving the cursor coordinates may decide to highlight oractivate a UI control that is positioned at corresponding coordinates.

Accordingly, at block 912, there are a number of various ways that theprocedure 700 can complete the task. The procedure 700 continues at “B”,represented by block 702 of FIG. 7.

An Exemplary Suitable Computing Environment

FIG. 10 illustrates aspects of an exemplary suitable operatingenvironment in which a stylus helper user interface may be implemented.The illustrated operating environment is only one example of a suitableoperating environment and is not intended to suggest any limitation asto the scope of use or functionality of the invention. Other well knowncomputing systems, environments, and/or configurations that may besuitable for use with the invention include, but are not limited to,personal computers, server computers, hand-held or laptop devices,portable interactive display devices, PDAs, digital tablets,multiprocessor systems, microprocessor-based systems, programmableconsumer electronics (e.g., digital video recorders), gaming consoles,cellular telephones, network PCs, minicomputers, mainframe computers,distributed computing environments that include any of the above systemsor devices, and so on.

FIG. 10 shows a general example of a computer 1042 that can be used inaccordance with the described arrangements and procedures. Computer 1042is shown as an example of a computer in which various embodiments of theinvention can be practiced, and can be used to implement, for example, acomputing device 104 of FIG. 1, a display device 102, a stylus helpermodule 114, registered stylus helper applications 116, otherapplications 118, operating services 120, and device/touch driver 122,and so on. Computer 1042 includes one or more processors or processingunits 1044, a system memory 1046, and a bus 1048 that couples varioussystem components including the system memory 1046 to processors 1044.

The bus 1048 represents one or more of any of several types of busstructures, including a memory bus or memory controller, a peripheralbus, an accelerated graphics port, and a processor or local bus usingany of a variety of bus architectures. The system memory 1046 includesread only memory (ROM) 1050 and random access memory (RAM) 1052. A basicinput/output system (BIOS) 1054, containing the basic routines that helpto transfer information between elements within computer 1042, such asduring start-up, is stored in ROM 1050. Computer 1042 further includes ahard disk drive 1056 for reading from and writing to a hard disk, notshown, connected to bus 1048 via a hard disk drive interface 1057 (e.g.,a SCSI, ATA, or other type of interface); a magnetic disk drive 1058 forreading from and writing to a removable magnetic disk 1060, connected tobus 1048 via a magnetic disk drive interface 1061; and an optical diskdrive 1062 for reading from and/or writing to a removable optical disk1064 such as a CD ROM, DVD, or other optical media, connected to bus1048 via an optical drive interface 1065.

The drives and their associated computer-readable media providenonvolatile storage of computer readable instructions, data structures,program modules and other data for computer 1042. Although the exemplaryenvironment described herein employs a hard disk, a removable magneticdisk 1060 and a removable optical disk 1064, it will be appreciated bythose skilled in the art that other types of computer readable mediawhich can store data that is accessible by a computer, such as magneticcassettes, flash memory cards, random access memories (RAMs), read onlymemories (ROM), and the like, may also be used in the exemplaryoperating environment.

A number of program modules may be stored on the hard disk, magneticdisk 1060, optical disk 1064, ROM 1050, or RAM 1052, including anoperating system 1070, one or more application programs 1072, otherprogram modules 1074, and program data 1076. A user may enter commandsand information into computer 1042 through input devices such as astylus 210 of FIG. 2, a keyboard 1078, and pointing device 1080. Otherinput devices (not shown) may include a microphone, joystick, game pad,satellite dish, scanner, or the like. These and other input devices areconnected to the processing unit 1044 through an interface 1068 that iscoupled to the system bus (e.g., a serial port interface, a parallelport interface, a universal serial bus (USB) interface, etc.). A stylusinput sensitive monitor 1084 (e.g., a touch-sensitive monitor) or othertype of display device is also connected to the system bus 1048 via aninterface, such as a video adapter 1086. In addition to the monitor,personal computers typically include other peripheral output devices(not shown) such as speakers and printers.

Computer 1042 operates in a networked environment using logicalconnections to one or more remote computers, such as a remote computer1088. The remote computer 1088 may be another personal computer, aserver, a router, a network PC, a peer device or other common networknode, and typically includes many or all of the elements described aboverelative to computer 1042, although only a memory storage device 1090has been illustrated in FIG. 10. The logical connections depicted inFIG. 10 include a local area network (LAN) 1092 and a wide area network(WAN) 1094. Such networking environments are commonplace in offices,enterprise-wide computer networks, intranets, and the Internet. Incertain embodiments of the invention, computer 1042 executes an InternetWeb browser program (which may optionally be integrated into theoperating system 1070) such as the “Internet Explorer” Web browsermanufactured and distributed by Microsoft Corporation of Redmond, Wash.

When used in a LAN networking environment, computer 1042 is connected tothe local network 1092 through a network interface or adapter 1096. Whenused in a WAN networking environment, computer 1042 typically includes amodem 1098 or other means for establishing communications over the widearea network 1094, such as the Internet. The modem 1098, which may beinternal or external, is connected to the system bus 1048 via a serialport interface 1068. In a networked environment, program modulesdepicted relative to the personal computer 1042, or portions thereof,may be stored in the remote memory storage device. It will beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused.

Computer 1042 also includes a broadcast tuner 1099. Broadcast tuner 1099receives broadcast signals either directly (e.g., analog or digitalcable transmissions fed directly into tuner 1099) or via a receptiondevice (e.g., via antenna or satellite dish).

Computer 1042 typically includes at least some form of computer readablemedia. Computer readable media can be any available media that can beaccessed by computer 1042. By way of example, and not limitation,computer readable media may comprise computer storage media andcommunication media. Computer storage media includes volatile andnonvolatile, removable and non-removable media implemented in any methodor technology for storage of information such as computer readableinstructions, data structures, program modules or other data.

Computer storage media includes, but is not limited to, RAM, ROM,EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disks (DVD) or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other media which can be used to store the desired informationand which can be accessed by computer 1042. Communication mediatypically embodies computer readable instructions, data structures,program modules or other data in a modulated data signal such as acarrier wave or other transport mechanism and includes any informationdelivery media. The term “modulated data signal” means a signal that hasone or more of its characteristics set or changed in such a manner as toencode information in the signal. By way of example, and not limitation,communication media includes wired media such as wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media. Combinations of any of the aboveshould also be included within the scope of computer readable media.

The subject matter has been described in part in the general context ofcomputer-executable instructions, such as program modules, executed byone or more computers or other devices. Generally, program modulesinclude routines, programs, objects, components, data structures, etc.that perform particular tasks or implement particular abstract datatypes. Typically the functionality of the program modules may becombined or distributed as desired in various embodiments.

For purposes of illustration, programs and other executable programcomponents such as the operating system are illustrated herein asdiscrete blocks, although it is recognized that such programs andcomponents reside at various times in different storage components ofthe computer, and are executed by the data processor(s) of the computer.

Alternatively, the invention may be implemented in hardware or acombination of hardware, software, and/or firmware. For example, one ormore application specific integrated circuits (ASICs) could be designedor programmed to carry out the described subject matter.

CONCLUSION

Although the above description uses language that is specific tostructural features and/or methodological acts, it is to be understoodthat the described arrangements and procedures defined in the appendedclaims are not limited to the specific features or acts described.Rather, the specific features and acts are disclosed as exemplary formsof implementing the described arrangements and procedures.

1. A computer-implemented method comprising: providing a user interfacefor use with a stylus in a computing device having a display; receivinga first stylus-based user input at a location on the display, thelocation corresponding to a previously displayed user interface objectwith a corresponding context of operation; responsive to receiving thefirst stylus-based user input, presenting a menu on the display, themenu being independent of the corresponding context of operation andcomprising selectable items comprising at least hover cursor input andhandwriting input; receiving a second stylus-based user input thatindicates user selection of an item of the selectable items; andresponsive to receiving the second stylus-based user input, directingthe computing device to interpret one or more subsequent stylus-baseduser inputs as hover cursor input or handwriting input.
 2. A method asrecited in claim 1, wherein if the item of the selectable items has notbeen selected for a predetermined amount of time since presenting themenu, the method further comprises dismissing the menu.
 3. A method asrecited in claim 1, further comprising: identifying stylus input outsideof the action area; and responsive to identifying stylus input outsideof the action area, dismissing the menu.
 4. A method as recited in claim1, further comprising: presenting the menu on the display responsive toreceiving a third stylus based user input; receiving a fourthstylus-based user input that indicates user selection of an additionalitem of the selectable items; and responsive to receiving the fourthuser input, (a) hiding the menu; and (b) performing a task correspondingto the item.
 5. A method as recited in claim 1, further comprising:presenting the menu on the display responsive to receiving a thirdstylus based user input; receiving a fourth stylus-based user input thatindicates user selection of an additional item of the selectable items;and responsive to receiving the fourth user input, (a) hiding the menu;and (b) performing a task corresponding to the additional item, the taskhaving a result; and (c) communicating the result as input to a program.6. A method as recited in claim 5, wherein the task comprises: (a)generating right-mouse-button data; (b) moving a cursor over thedisplay; (c) generating keyboard data; or (d) generating handwritingdata.
 7. A computing device having a display, the computing device forproviding a user interface for use with a stylus, the computing devicecomprising: a processor; and a memory coupled to the processor, thememory comprising computer-program instructions executable by theprocessor for: receiving a continuous touch stylus-based user input at alocation on the display, the location corresponding to a previouslydisplayed user interface object with a corresponding context ofoperation; and responsive to receiving the continuous touch stylus-baseduser input, presenting a menu on the display, the menu being independentof the corresponding context of operation and comprising selectableitems comprising at least hover cursor input and handwriting input;receiving a second stylus-based user input that indicates user selectionof an item of the selectable items; and responsive to receiving thesecond stylus-based user input, directing the computing device tointerpret one or more subsequent stylus-based user inputs as hovercursor input or handwriting input.
 8. A computing device as recited inclaim 7, further comprising instructions for: responsive to determiningthat the item has not been selected within a predetermined amount oftime since presenting the menu, dismissing the menu; and responsive toidentifying stylus input outside of the action area, dismissing themenu.
 9. A computer-readable storage medium comprising computer-programinstructions executable by a processor for: providing a user interfacecomprising an action area, the action area including at least one helpericon, the at least one helper icon being selectable to allow a user tospecify that a computer system is to interpret one or more subsequentstylus-based user inputs as a particular type of input of multiplepossible types of input, the multiple types of input comprising atleast: mouse-right-button input, hover cursor input, keyboard input, andhandwriting input; wherein the action area is for display responsive toreceiving a continuous touch stylus-based user input; and whereinhandwriting input selection allows the user to provide handwriting inputwithout being confined to a window of the underlying program.